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DETAILED ACTION 

1 . This action is responsive to applicant's filling of a Request for Continued 
Examination, filed on 2/14/2005. 

2. The response filed 2/14/2005 did not include a current listing of the claims. 
In this action, the examiner references the most current listing of claims, as 
contained in the amendment filed 4/22/2004. 

3. Claims 1-6, 9, 11, 12, 14 and 25-30 are pending in the case. Claims 1, 6, 9, 
12 and 25 are independent claims. 

4. Examiner's rejection of Claims 1-6, 9, 12, 25 and 27, made under 35 USC 
103, as being unpatentable over Escobar et al. US Patent 5,659,793 in view 
of Bergman et al. US Patent 6,564,263 as recited in the previous office action 
(dated 8/13/2004) are withdrawn in view of applicant's arguments. 

5. Examiner's rejection of Claims 11, 14, 26 and 28-30, made under 35 USC 
103, as being unpatentable over Escobar et al. US Patent 5,659,793 in view 
of Bergman et al. US Patent 6,564,263 in further view of Gill et al. US Patent 
6,081,262 as recited in the previous office action (dated 8/13/2004) are 
withdrawn in view of applicant's arguments. 
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Claim Rejections - 35 USC § 103 

6. The following is a quotation of 35 U.S.C. 103(a) which forms the basis for 

all obviousness rejections set forth in this Office action: 

"(a) A patent may not be obtained though the invention is not identically 
disclosed or described as set forth in section 102 of this title, if the 
differences between the subject matter sought to be patented and the 
prior art are such that the subject matter as a whole would have been 
obvious at the time the invention was made to a person having ordinary 
skill in the art to which said subject matter pertains. Patentability shall not 
be negatived by the manner in which the invention was made." 

7. Claims 1-6, 9, 12, 25 and 27 are rejected under 35 U.S.C. 103(a) as being 
unpatentable over Escobar et al. US Patent 5,659,793, filed 12/22/1994, 
patented 8/19/1997, (hereinafter "Escobar 3 ') in view of Wittenburg et al. US 
Patent 6,515,656, filed 4/30/1999, patented 2/4/2003, (hereinafter 
tt Wittenburg). 

8. Regarding independent claim 1, the applicant defines temporal and 
nontemporal media as "temporal media, such as video, audio and computer- 
generated animation, and nontemporal media, such as still images, text, 
hypertext documents etc" (page 4, lines 12-14). Escobar discloses in Figure 
1, a graphical user interface for authoring presentations, with a temporal 
media timeline (shown as "Video Time Line" at reference signs 140 and 141), 
nontemporal media timelines (shown as "Program Object Time Line" at 
reference sign 160). Escobar discloses a specification for the multimedia 
presentation. Escobar recites: 'To develop a program object, first, a 
specification (400) for the object is prepared' (column 8, lines 56-57). 
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Escobar discloses a viewer having access to and using the timeline and 
the specification, to displays the media presentation. Escobar recites "Button 
1 74 permits part or all of an application under development to be run and 
displayed at a location specified, typically in the Display/Edit Window 100, so 
that the impact of the decisions made in editing of a portion or all of an 
application may be viewed under run time conditions" (column 6, lines 41-45). 
Escobar further recites: "Button 173 invokes application creation or editing 
functions which permit objects to be assembled into applications with relative 
timing specified by their placement along the timeline tracks" (column 6, lines 
37-41). 

Escobar discloses an encoder to output a media presentation from the 
timeline and the specification. Escobar recites: u the objects can be combined 
and only the combined integrated final application can be sent as a live 
program" (column 20, lines31-33). 

Escobar discloses a graphical user interface for authoring presentations 
with temporal and nontemporal media and their timelines, and a specification 
for the multimedia presentation. Escobar fails to disclose a specification that 
defines the portion of the display area in which of the first and second media 
tracks will be displayed (i.e. the spatial relationship). Wittenburg teaches 
controlling the spatial relationships of the display of the media objects. 
Wittenburg recites: "The techniques described are capable of using a number 
of different spatial layout techniques and transitions for rendering individual 
multimedia data items to be presented in a particular presentation area" 
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(column 14, lines 39-42). Wittenburg further illustrates several presentations 
with spatially related media objects in Figures 6-10. 

Therefore, it would have been obvious, to one of ordinary skill, at the time 
the invention was made, to combine the multimedia authoring tool of Escobar 
with the use of spatial relationships, as taught by Wittenburg, in order to 
create "a technique for viewing and selecting information by incorporating 
imagery and other media, as well as text, that uses a hierarchical 
organization, and deploys controls for speed and direction of information 
presented 1 (Wittenburg, column 2, lines 19-23). 

9. Regarding dependent claim 2, Escobar discloses multiple servers 
managing multimedia and data files (together and separately) in Figure 13. 
Escobar further recites "The IDL is stored as an application at 5565 and the 
process returns to the main routine" (column 1 , lines 44-45). 

10. Regarding dependent claim 3, Escobar recites "When an IDL is executed, 
the DET takes the items on the list in order and requests the objects specified 
by the list item by sending a request over the network to the server" (column 
20, lines 16-19). 

11. Regarding dependent claim 4, Escobar recites "the server controls a 
retrieval of objects and the assembly of those objects into a program which is 
then delivered to the end user for display at 1130" (column 20, lines 38-41). 
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12. Regarding dependent claim 5, Escobar discloses transferring and 
previewing (see above). Escobar discloses previewing prior to transferring in 
"The module is then tested (425) and reviewed by the developer or customer 
for acceptance (430). Once the object is moved to production in the 
authoring tool (435), installed in the correct bin (440) and an appropriate icon 
attached (445), it is ready for use as desired (450) by the non-programmef 
(column 8, lines 62-67). 

13. Regarding independent claim 6, Escobar discloses timelines for the 
temporal and nontemporal media, as described above. Escobar discloses a 
table of contents track. Escobar recites: "At least one interactive object track 
160 should be included 1 (column 6, lines 26-28). Escobar discloses a table of 
contents track that includes character elements associated with a point in 
time on the table of contents track. Escobar recites: "One timeline is 
dedicated to interactive objects. Control of playback or execution of the 
objects is achieved using edit decision lists (EDL) and interactive decision 
lists (IDL) which capture the editing decisions made by a user of the tool. The 
interactive decision list is used to activate retrieval of objects from assets 
stored, to initiate playback of the objects retrieved and to initiate loading and 
execution of program objects all in a sequence corresponding to that 
represented on the timelines" (column 4, lines 17-25). 

Escobar and Wittenburg disclose the control of display spatial 
relationships of media objects, and a display for displaying the media objects 
based upon the timelines and the spatial relationship, as described above. 
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Escobar discloses the user selection of a displayed character in the table of 
contents track that initiates the presentation playback to the point in time 
related to the selected element. Escobar recites: "Playback or running of the 
interactive multimedia application can be controlled by executing an IDL at 
either an end user's location or at a server's location" (column 4, lines 27-29). 

14. Regarding independent claim 9, the claim contains substantially the 
same subject matter as claim 1 , and is rejected using the same rationale. 

15. Regarding independent claim 12, the claim contains substantially the 
same subject matter as claim 1 , and is rejected using the same rationale. 

16. Regarding independent claim 25, the claim is directed toward a computer 
program product for the system of claim 1 , and is rejected using the same 
rationale. 

17. Regarding dependent claim 27, the claim is rejected for fully incorporating 
the deficiencies of the base claim. 

18. Claims 11, 14, 26 and 28-30 are rejected under 35 U.S.C. 103(a) as being 
unpatentable over Escobar in view of Wittenburg, and in further view of Gill et 
al. US Patent 6,081,262, filed 12/4/1996, patented 6/27/2000, (hereinafter 
"Giir). 

19. Regarding amended dependent claim 11, Escobar and Wittenburg 
disclose a multimedia authoring system using timelines of temporal and 
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nontemporal media. Escobar and Wittenburg fail to disclose the use of a time 
bar to manipulate the media time lines. Gill discloses the use of a time bar in 
Figure 2, at reference sign PL. 

Therefore, it would have been obvious, to one of ordinary skill, at the time 
the invention was made to combine the multimedia authoring system of 
Escobar and Bergman with the controllable time bar of Gill in order "to 
combine media objects of multiple diverse types into an integrated multi- 
media presentation" (Gill, Column 1 , lines 8-10). 

20. Regarding dependent claims 14 and 26, the claims contain substantially 
the same subject matter as claim 11, and are rejected using the same 
rationale. 

21. Regarding dependent claim 28, Escobar and Wittenburg disclose a 
multimedia authoring system using timelines and spatial relationships of 
temporal and nontemporal media. Escobar and Wittenburg fail to disclose the 
display area divided into frames. Gill teaches the use of display frames. Gill 
Discloses in Figure 2, a text frame (shown at reference sign TB) and a movie 
frame (shown at reference sign MB). 

Therefore, it would have been obvious, to one of ordinary skill, at the time 
the invention was made to combine the multimedia authoring system of 
Escobar and Bergman with the display frames of Gill in order "to combine 
media objects of multiple diverse types into an integrated multi-media 
presentation" (Gill, Column 1, lines 8-10). 
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Regarding dependent claims 29 and 30, Escobar, Wittenburg and Gill 
disclose a multimedia authoring system using timelines and spatial 
relationships of temporal and nontemporal media. Escobar and Gill fail to 
disclose the multimedia presentation defined by a markup language 
document (claim 29) and where the markup language document contains 
additional nontemporal media (claim 30). Wittenburg discloses the use of 
markup language documents with nontemporal media. Wittenburg recites: 
"user interface components may include, for example, JAVA Script code and 
data, and dynamic HTML files" (column 4, lines 36-38). 

Therefore, it would have been obvious, to one of ordinary skill, at the time 
the invention was made, to represent the multimedia presentation of Escobar 
and Gill as a markup language document with additional content, as taught by 
Wittenburg, in order to create "a technique for viewing and selecting 
information by incorporating imagery and other media, as well as text, that 
uses a hierarchical organization, and deploys controls for speed and direction 
of information presented" (Wittenburg, column 2, lines 19-23). 
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Response to Arguments 

22. Applicant's arguments with respect to claims 1-6, 9, 11, 12, 14 and 25-30 
have been considered but are moot in view of the new grounds of rejection, 
as described above. 



Conclusion 

23. The following prior art made of record and not relied upon is considered 
pertinent to applicant's disclosure: 



Patent 


Date 


Inventor 


US-5,481,664 


01-1996 


Hiroya et al. 


US-5,659,790 


08-1997 


Kim et al. 


US-5,669,006 


09-1997 


Joskowicz et al. 


US-5,71 7,438 


02-1998 


Kim et al. 


US-5,742,283 


04-1998 


Kim, Michelle Yoonkyung Lee 


US-6,061,696 


05-2000 


Lee et al. 


US-6,237,025 


05-2001 


Ludwig et al. 


US-6,292,827 


09-2001 


Raz, Uri 


US-6,665,732 


12-2003 


Garofalakis et al. 



24. Any inquiry concerning this communication or earlier communications from 
the examiner should be directed to Gregory J. Vaughn whose telephone 
number is (571) 272-4131. The examiner can normally be reached Monday to 
Friday from 8:00 am to 5:00 pm. 

If attempts to reach the examiner by telephone are unsuccessful, the 
examiner's supervisor, Stephen S. Hong can be reached at (571) 272-4124. 
The fax phone number for the organization where this application or 
proceeding is assigned is (571) 272-2100. 
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Information regarding the status of an application may be obtained from 
the Patent Application Information Retrieval (PAIR) system. Status 
information for published applications may be obtained from either Private 
PAIR or Public PAIR. Status information for unpublished applications is 
available through Private PAIR only. For more information about the PAIR 
system, see http://pair-direct.uspto.gov. Should you have questions on 
access to the Private PAIR system, contact the Electronic Business Center 
(EBC) at 866-217-9197 (toll-free). 



Gregory J. Vaughn 
May 5, 2005 




STEPHEN HONG 
SUPERVISORY PATENT EXAMINER 



